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Abstract : Our purpose is to study a particular class of optimal stopping problems for 
Markov processes. We justify the value function convexity and we deduce that there exists a 
boundary function such that the smallest optimal stopping time is the first time when the Markov 
process passes over the boundary depending on time. Moreover, we propose a method to find 
the optimal boundary function. 
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1 Introduction 

In this paper we study a particular optimal stopping problem for strong Markov processes. We 
propose a method to find the optimal stopping time form (it will be the first time when the 
Markov process passes over a boundary depending on time), as well as for the calculation of the 
optimal boundary. 

In fact we seek to control a stochastic process V of the form V = ve x where v is a real strictly 
positive constant and X a strong Markov process. We consider the following optimal stopping 
problem : 

s(v) = sup T& A^ [e~ TT h(V T , t) I Vo = v] , 

where r > 0, = &(V S , s < t), A is the set of ^^-stopping times and h is a Borelian function 
h(V,t) = —V + ce mt , c > 0, m < r. We prove that our problem may be easily reduced to an opti- 
mal stopping problem for Markov processes and linear reward (i.e. supr^^E [e~ TT f(V T ) \Vq = v) 
where / is a linear function). We justify the convexity of the value function s and we deduce that 
the optimal strategy consists of stopping when the underlying Markov process crosses a boundary 
depending on time, i.e. the smallest optimal stopping time has the form inf{t > : Vt < b(t)}. 
The main result is given by Theorems 13.11 13.31 and 13.41 which allow to determine the optimal 
stopping time form and the optimal boundary function. 

Optimal stopping theory is a subject which often appears in the specialized literature. For 
different areas of application or different methods for optimal stopping problems see, for example, 
Peskir and Shiryaev (2003). Among others, Salminen (1985), Leland (1994, 1996, 1998), Duffie 
and Lando (2001), Dayanik and Karatzas (2003) or Decamps and Villeneuve (2007, 2008) studied 
optimal stopping problems for continuous Markov processes. Moreover, there are other authors 
who used Levy jumps processes (e.g. Pham (1997), Mordecki (1999), Hilberink and Rogers 
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(2002), Kou and Wang (2004), Dao (2005), Kyprianou (2006), Dorobantu (2007)...) or symmetric 
Markov processes (e.g. Zabczyk (1984)) for their models. Sometimes the studied problem has the 
form sup T >oE, [e~ rT h(V T )], other times it is more complicate sup T >oK [e~ rT h(V T , r)] . Our result 
completes these studies and the aim of the present paper is to solve a stopping time problem for 
a more general class of processes (more precisely, Markov processes not necessarily continuous). 
Contrary to the usual method, our method avoids long calculations of the integro-differential 
operators. 

This paper is organized as follows : we introduce the optimal stopping problem (Section 
[2]). The following section (Section [3]) contains the main results which characterize the optimal 
stopping time and the optimal boundary. Section [4] is dedicated to the proofs of Theorems 13.11 
EHl and ET31 



2 Optimal stopping problem 

Let V be a stochastic process on a filtered probability space (f2,.F, (^ r t)t>o,P). Assume that V 
has the form V = ve x where v is a real strictly positive constant and X is a strong Markov 
process such that Xq = 0. Let be the right-continuous complete filtration generated by the 
process V, = c(Vs, s <t). We introduce A the set of .F^-stopping times. 

Prom now on, E(.|Vb = v) and P(.|Vb = v) are denoted E„(.) and P„(.). 

We consider the following optimal stopping problem : 

s(v) = sup TeA K [e- rr (-V T + ce mr )] , (1) 

where r, c > and r > m. 

We suppose that the process X checks the following assumptions : 

Assumption 2.1 F(limtioX t = Xq) = 1. 

Assumption 2.2 The process (e~ rt+Xt , t > 0) is of class D. 

Assumption 2.3 inf t > e- rt E(e Xt ) = 0. 

Assumption 2.4 The support of X t is R for all t > 0. 

Under Assumptions 12.11 12.21 12.31 and 12.41 we prove that the smallest optimal stopping time 
of CD) is necessarily of the form inf{t > : V% < b(t)} and we compute the optimal boundary 
function. We applied the same method in (TUl EE] for Levy processes and linear functions (i.e. 
m = 0), but it may be extended to a more general class of processes and reward functions. 
The same type of problem as ([T]) has been studied in |TT] for a particular Markov process. The 
method used in [Tl] is different and it could be applied because the model is easy. 
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3 The main results 



The main results caracterize the smallest optimal stopping time of ([T]). We show the following. 



Theorem 3.1 Under Assumptions \2. 1\ \KM E3 and \2.J\ there exists at least an optimal stopping 
time for the problem |7p. 

For any c > 0, there exists b c > such that the smallest optimal stopping time has the 
following form 

inf{t > : V t < b c e mt }. 



We introduce an auxiliary function 



Sb(V 



E, 



-(r-m)r b 



-mr b 



V n + c) 



v G 



where Tb = inf{t > : e mt Vt < b}. Let us point out that if b £ 
positive. The condition b s]0, c[ implies the positivity of Sb(-). 



6e]0,c[ 

L+, then s&(.) is not necessarily 



Remark 3.2 Under the assumptions of Theorem \3.1\ there exists B c such that sb c {-) = s( 
Remark that we can write s.(.) as a function of Laplace transforms 



C{x) = E 



< r - m ^\X = ol , Q(x 



E 



-(r-m)T x +Xr x \v 







where X is the process defined by t \— > X t 
the function s.(.) can be written as 



-mt + X t and t x = inf{t > : X t < x}. Indeed, 



Sb(v) = —vQ (in— ] + cC ( In— 
V vj \ v 

The following theorems caracterize the value of the optimal threshold B c as a function of c, 
£(.) and £(.)• 

When Q is discontinuous at x = 0, -B c is easy to obtain. 



Theorem 3.3 Under Assumptions \2.1l \2.2l \2.3\ and \2.4\ we suppose that the function Q is 
discontinuous at x = 0. Then the smallest optimal stopping time is r* = inf{t > : Vt < B c e mt }, 
where B c = c lim x ^ {Zgfy ■ 

When Q is continuous at x = 0, B c is more technical to obtain, but it has the same form. 



Theorem 3.4 Under Assumptions \2.1\ \2.2\ \2.3\ and \2.J\ we suppose that the function Q is 
continuous at x = 0. Then we have the following : 

1. If Q has left derivative at x = (say then C has left derivative at x = (say 
£i(0-)). 

2. If moreover ^'(CT) ^ 0, then B c € [b, c[ where b = c lim x ^ fz§£jn ■ 

3. If moreover s^(.) is strictly convex on ]b, oo[, 

then the smallest optimal stopping time is t* = inf{t > : Vt < B c e mt }, where B c = b. 
The proofs of Theorems 13.11 13.31 and 13.41 are given in Section [U 



4 Appendix - Proofs 



Before starting with the proof of Theorem 13.11 it is useful to re- formulate the problem JT]). For 
this purpose, following Gabillon (2003), we introduce a new process v. 



Notation 4.1 Let v be the process defined by v : t i— > ve 



-mt+Xt i 



ve 



Xt ). We sometimes use the 



notation v v = ve x , for v > 



The right-continuous complete filtration generated by the process v is identical to T v . The 
problem JT]) may be written as 



S(y) = SUp T( zA^v 



-(r—m)r 



/Or) 



(2) 



where / is a decreasing linear function, f(v) = — v + c, v > 0. Therefore, problem JT]) can be 
reduced to an optimal stopping problem for Markov processes and linear functions. 

The proof of Theorem 13.11 requires several results. 

Remark that s is a (decreasing) convex function because it is the sup of (decreasing) linear 
functions : 



s(v) = sup T > E v 



-(r—m)T( v 



{-v v T + c) =sup T > E 1 e -(— )-(- w i +( 



Remark 4.2 Since s is a convex function, then it is continuous. 

The function s is a positive function because 
s(v) > su Pt >oK [e-( r - m + c)] > sup t >oK [-e-f r - ro )*i/ t ] = sup t > - vE [ e - rt+Xt ] = 0, 

where for the last equality we used Assumption 12.31 

Under Assumption E2J the process (e _( - r_m - ) */(fi), t > 0) is of class D. According to Theorem 
3.4 of |16j . the Snell envelope of this process has the form {e~ <yr ~ m ^ t s{vt)i t>0). Theorem 3.3 
page 127 of [27], allows us to find the optimal stopping of a problem sup T >oE, v [f{y T )} where / 
is a measurable function. We easily deduce that this result may be applied to a process having 
the form t t— > e~ rt f{v t ). In our case, we can not apply this result for the problem JT]) because 
the process t i— > e _ ^ r_m ^/(f t ) does not check the assumptions of Theorem 3.3 page 127 of [27] ; 
that is why we rewrite the function s under a new form. 

Lemma 4.3 For v > 0, let s + (v) = sup re A^v [e~( r ~ m ' T (— v T + c) + ] , where x + = max(x,0). 
Under Assumptions \2. 11 GQ| 1^.31 and\2.^\ s + {v) > and s(v) = s + (v) for every v > 0. 



Proof We show that if there exists vq > such that s(vq) < s + (vo), then there exists v% > 
such that s + (vi) = 0. We prove that this last relation can not be satisfied. 

By construction, for each v > 0, s(v) < s + (v). Let us suppose that there exists vo > such 
that s(vq) < s + (vq). 
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Under Assumption 12.11 the process v m is right continuous at 0. Since the process Y + : t — > 
Y t + = e-( r ~ m )*(— vt + c) + takes its values in [0, c], the assumptions of Theorem 3.3 page 127 of 
[27] are checked for Y + . We denote by / + the function f + (v) = (— v + c) + ; the stopping time 

r+ = m/{n>0:/ + K«)= S + K°)} 

is the smallest optimal stopping time of the problem s + (vq) = sup T >ofiL vo [e~( r ~ m ) T (— v T + c) + ] . 
Using the definition of s and s + , we have 



E, 



and consequently 



^ T+ f{v T+ )\ <s(v )<s + (v )=E V0 



3 — (r— m)r+ f+ 



(r-m)r+ ( /( ^ +) _ /+ (i , T+ ))l < , P„, ({ W : /(z, T+ ) < 0}) > 



and F Vo {{u : s + (z^ T+ ) = 0}) > 0. 

Thus there exists v% such that s + (v\) = 0. Then for any stopping time r, ¥ Vl -almost surely 
e~( r ~ m > T /+ (v T ) = and in particular for every t € M + , f + {vt) = 0. This involves that P Vl - 
almost surely ft > c which is a contradiction because under Assumption 12.41 the support of v t 
is R^_. Therefore s + (v) > for every v £ W* + and s(v) = s + (v). □ 



Thanks to Lemma [4731 the problem (Q]) can be brought back to an optimal stopping problem 
for an American Put option with strike price c. Such a problem has been studied by many authors 
when X is a Levy process (see for exemple Gerber and Shiu (1994), Pham (1997), Mordecki 
(1999), Boyarchenko and Levendorskii (2002), Avram, Chan and Usabel (2002), Chesney and 
Jeanblanc (2004), Asmussen, Avram and Pistorius (2004), Alili and Kyprianou (2005), Kyprianou 
(2006)). Next, we use a method close to the one used by Pham (1997). Pham studies an optimal 
stopping problem for an American Put option with finite time horizon. In his model A is a Levy 
process. He uses integro-differential equations to solve his problem. 
Proof of Theorem I3TT1 

By Lemma 14751 the problem ([T]) can be written as sup T >oE(y T + ). By Theorem 3.3 page 127 
of [27], r* = inf{u > : / + (^«) = s + (f u )} is the smallest optimal stopping time. However 
s(v) = s + (v) > for all v > 0, so 

r* = inf{u > : f(u u ) = s(v u )} 

is the smallest optimal stopping time. 

The function s is upper bounded by c because Y + is upper bounded by c and lim v ios{v) = 
Hm v iof(v) = c. 

Since s is convex, / linear and /(.) < s(.), then {v > : f(v) = s(v)} is an interval of the 
form ]0, b c ]. This means that the smallest optimal stopping time r* is also the first entrance 
time of v in ]0, b c ]. □ 



The smallest optimal stopping time is hence a hitting time for the process v. 
Proof of Theorem [3731 

Let b e]0, c[. The function s&(.) has the form 
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Sb(v) 



-v + c if v < b 

-vQ [ln b -) + cC [ln b -) if v>b. 

If the function s&(.) is continuous at b, then b is solution of 



-& + c=-&0(O~) + c£(O-). (3) 

However, <5 is discontinuous at x = 0, so <5(0~) 7^ 1 and the equation j3]) has only one solution : 

l-£(0~) l-£(x) 
b = c- = c hm x ^ - 



1-0(0-) X|U l-£(x)' 

The function s has the form ss c (.) = s(.) and is convex, thus it is continuous, in particular 
it is continuous at B c . We deduce that B c = b* . □ 
Proof of Theorem ET4l 

(1) By Remark 13.21 there exists B c such that ss c (.) = s(.). The function s is convex, therefore 
the right and left derivatives exist everywhere and 

s'{y-) < s'{v + ) for all v e M% (4) 

where s'(v~) and s'(u + ) are the left and right derivatives of s at v. In particular, this means 
that 

sb c (v) = —vQ (lri^\ + cC (^Ln^^j = s(v) 

has right and left derivatives at v = B c . Since Q has right and left derivatives at x = 0, then C 
has also right and left derivatives at x = 0. 

(2) Let us make v = B c in JH) : 

-1 < -1 + £'(0-) - -^-£'(0-). 

-De 

We deduce that B c >b = c g/(o- j = c ^ m xio \-g(x) • 

(3) If moreover sr(.) is strictly convex on ]b , oo[, then 

s- b (v) > f(v) for all v > b. (5) 

Indeed, the graph of / is tangent to the graph of s^(.) in v = b. 

Suppose that B c > b, then f(B c ) = s(B c ) = sb c (B c ) > sr(B c ) which contradicts j5]). □ 



Remark 4.4 Assumption \2.S\ may be replaced by 

"There exists q £ R smc/i i/iai i/ie support of X t is included in ] — 00, g] /or a// 1 > 0. " 

Under this assumption, we don't need to use the intermediate Lemma \4-3\ to find the smallest 
optimal stopping time form. In this case the process (/(ft), t > 0) is bounded and Theorem 3.3 
page 127 of ]27$ can be directly applied. The function s is not necessarily continuous, but its 
continuous extension by linear interpolation is convex and the conclusion of Theorems \3.1\ \3.3\ 
and \3.4\ are true. 
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Our results are consistent with existing literature. Recall that our problem can be brought 
back to an American Put optimal stopping problem for strong Markov processes. Various authors 
have found that, in the case of a Levy process, the American Put optimal stopping problem 
is linked to the first passage problem of the Levy process. Moreover, the optimal threshold 
is obtained using continuous or smooth pasting condition. For example, in [TJ [4] sufficient 
or necessary and sufficient conditions for smooth and continuous pasting were established for 
different classes of Levy processes. To this subject (but for a different optimal stopping problem), 
see also |19j . The aim of this paper is to solve a little more general problem than the American 
Put optimal stopping problem, for a more general class of processes. 
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